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PROGRAMMABLE LENS ASSEMBLIES AND OPTICAL SYSTEMS 

INCORPORATING THEM 

This invention relates to programmable lens assemblies and optical 
5 systems that incorporate them. 

It is sometimes desirable to be able to alter the field of view, or plane 
within a field of view, that is focused by an optical system (or optical 
assembly) to a focal plane. For example a detector, or array of detectors 
10 (e.g. pixellated camera detector), may be provided and may have an 
imaging plane at which it detects an image, and it may be desirable to 
change what plane in 3-D space it is that is focused by the optical 
elements of the assembly onto the imaging plane. 

15 This is conventionally achieved by mechanical movement of lenses. To 
direct the optical system to detect from a different angle it is known to 
point the optical assembly to a different angle, or design a system with a 
wide field of view. 

20 According to a first aspect the invention comprises an optical assembly 
having an optical input, a spatial light modulator (SLM), a controller 
(e.g. a computer or microprocessor controller) controlling the display of 
the SLM, and a detector; the controller being adapted to modify a pattern 
displayed on the SLM so as to cause the SLM, in use, to control the 

25 radiation incident upon the SLM from the optical input so as to focus onto 
the detection radiation from a computer-selected surface or region in 3-D 
space in the scene that the optical assembly is observing. 

Thus, the pattern (such as a diffraction pattern, reflection pattern or 
30 refraction pattern) exhibited by the SLM is programmed by the 
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computer/controller and is in some embodiments capable of being changed 
rapidly. 

The pattern on the SLM is programmed to change under the control of the 
5 controller, but the SLM and detector remain fixed relative to each other. 
The assembly may have no moving mechanical optical parts that move 
grossly relative to the detector. 

Preferably the SLM has a rate at which its display can be changed and the 
10 controller is capable of programming the pattern to change at substantially 
as fast a rate as that at which the display of the SLM is capable of being 
changed. 

The pattern on the SLM may be changed at least as fast as once an hour, 
15 once a minute, once a second, or ten times a second, or one hundred 
times a second, or one thousand times a second or ten thousand times a 
second, or one hundred thousand times a second, or faster, or at a rate 
that is in a range defined between any of the above points. 

20 Preferably the pattern displayed, in use, is (i) substantially a linear 
pattern, or (ii) substantially a quadratic or higher order pattern, or (iii) a 
combination of (i) and (ii). It may be desirable to change a pattern from 
being a true linear pattern or a true quadratic, cubic, or higher order 
pattern (or a combination of such true patterns) to a pattern that is 

25 substantially similar but modified to have modified performance. 

Preferably the pattern has a component composed of a substantially linear 
diffraction grating pattern and/or a component comprised of a quadratic 
chirp function. The diffraction and chirp patterns may be binary, or have 
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more levels of quantisation. The patterns may vary the phase or 
amplitude of incident light, or both. 

Preferably the controller has a library of possible linear and/or chirp 
5 functions. Preferably a selected combination of linear and chirp functions 
from the library are, in use, applied to the SLM. Alternatively the 
controller, or some other device, may calculate the patterns, preferably in 
real time. However, a library is preferred. 



10 Preferably the detector comprises a line array of detector elements. There 
may be a plurality of detector elements in the array, or only one (single 
element array). Preferably the controller is adapted to control the display 
on the SLM to scan the scene image over the detector array, preferably in 
a direction generally transverse to the direction of the linear array. The 

15 linear array may comprise a straight line, linear, array, but it may 
comprise a simple array. 

Preferably, the controller is adapted to scan different angular portions of 
the scene (angularly disposed in azimuth and/or altitude/ascension relative 
20 to the optical axis of the assembly) by modifying the linear component of 
a combined pattern on the SLM. 

It may be possible to image any point or combination of points in a 3-D 
space onto the detector, which may be a single element. 

25 

Preferably the controller is adapted to focus different depth regions of 3-D 
scene space over the detector by controlling the SLM to display patterns 
with different chirp functions. The chirp function may provide a scanning 
focus in the z direction, depth. 
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According to another aspect the invention comprises a programmable 
focus element assembly which includes a programmable SLM capable of 
displaying light-modulating patterns which in use control the depth focus 
and direction from which light is focused by the lens assembly. 

5 

This is achieved preferably in real time. Preferably many different focus 
arrangements are exhibited on the SLM each second. 

According to another aspect the invention comprises the use of a linear 
10 grating and/or a chirp grating exhibited on a programmable SLM to 
control the part of a scene that is directed onto a detector. The part of the 
scene may be focused or imaged onto the detector. 

Preferably a point, or points, in 3-D space are focused onto a detector, 
15 the SLM being programmed by the controller. Preferably many points 
per second (e.g. thousands) are focused onto the detector. 

According to a further aspect the invention comprises a method of 
directing a scene image onto a detector comprising using a programmed 
20 SLM to control the x-y part of the scene image that is directed onto the 
detector and/or the depth of the plane of the scene in the z direction that 
is directed onto the detector, the scene-detector direction being in the z 
direction. 

25 The plane in the scene that is projected onto the detector may be focused 
onto the detector. However, for some applications it may not be in focus 
on the detector, for example it may be slightly out of focus. 

Preferably a chirp is applied to the SLM. Preferably a linear grating is 
30 applied to the SLM. Alternatively, patterns that are substantially a chirp 
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or substantially a linear grating, or substantially a combination of them, 
may be applied to the SLM. 

Preferably the orientation of the linear grating and/or the spacing of the 
5 lines of the grating are controlled so as to control the off-z axis location 
of region of the scene that is directed onto the detector. Preferably the 
chirp is used to determine the distance from the detector of the plane in 
3-D space in the scene that is focused to the detector. 

10 Preferably the display on the SLM is programmably controlled so as to 
scan the scene image over the detector over time, with the detector taking 
time-spaced records of what it detects. Preferably, the detector is a line 
detector, as opposed to a 2-D array of detectors (but it could be a 2-D 
array) . 

15 

Preferably the programmed SLM compensates for aberration in an optical 
system. 

According to another aspect the invention comprises an optical system 
20 having an aberration, and a programmed SLM which compensates for the 
aberration. 

The compensation may be partial or substantially total compensation. 

25 According to another aspect the invention comprises a method of 
producing an image comprising having a detector and scanning portions of 
a scene over the detector so that the detector detects scene information 
relating to different scene portions at sequential times, and building up an 
image representative of the scene by reading the detector to read the 
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detected signals representative of each scene portion and producing an 
image from the time-spaced read-outs of the detector. 

Preferably the method comprises having a simple detector array. This 
5 facilitates fast read-out. 

Preferably, the method comprises using an SLM, preferably 
computer-controlled, to control radiation incident from the scene to effect 
the scanning of the scene portions over the detector. 

10 

Preferably, the method comprises increasing or decreasing the number of 
pixels in the image by scanning more, or less, than the scene is scanned 
when fewer, or more, pixels in the image are required. 

15 Preferably, the method comprises increasing, or decreasing, the resolution 
of the image by scanning more, or less, than the scene is scanned for a 
lower resolution image. The image may be a 2-D image or a 3-D image. 

Preferably, the method comprises increasing or decreasing the field of 
20 view of an optical assembly by scanning the scene across a greater or 
smaller extent in the x-y plane of the scene. 

According to another aspect, the invention comprises imaging apparatus 
having a detector and a scanner, the scanner being adapted to scan parts 

25 of a scene over the detector, with radiation from different parts of the 
scene being directed onto the detector at different times, and a detector 
read-out adapted to read out signals from the detector and provide them to 
an image compiler, with signals at different times representing different 
parts of the scene, and the image compiler being adapted to create an 

30 image of the scene from the read-out signals. 
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Preferably, the scanner is adapted to scan the scene in 3-D space and 
direct radiation from different 3-D volumes in the scene space onto the 
detector. The image may be a 3-D image. The scanner may comprise an 
5 SLM. The SLM may be controlled by control means to display 
light-modulating patterns which effect the scanning of the scene over the 
detector. The SLM may be controlled to display combined chirp patterns 
(substantially linear and substantially quadratic or higher function). 

10 Preferably, the controller is adapted to control the SLM to scan parts of 
the scene over the detector at a fast rate. The rate of scan may be of the 
order of one thousand, ten thousand, or one hundred thousand (or more) 
parts of the scene projected onto the detector per second. 

15 The detector may comprise a single detector element or an array of 
detector elements, such as a 1-D or 2-D array. The detector may 
comprise a simple array of detector elements. 

The apparatus may be adapted to change the resolution of the image 
20 formed by the image computer by altering the scanning of the parts of the 
scene over the detector. If the scene is scanned onto the detector elements 
with finer "scene pixel" /smaller parts of the scene incident on the detector 
at any one time, the resolution of the image will be improved. If the 
scene is scanned so that a greater area in the x-y plane of the scene (scene 
25 to detector direction being the z direction) , then a wider field of view will 
be "seen" by the detectors and the image produced by the image computer 
can have a wider field of view. 



The apparatus may comprise a camera. 



30 



WO 00/1 781 0 PCT/GB99/03000 

8 

The apparatus may be adapted to be able to change the aperture size of the 
imaging system. An aperture size changer provided to do this may 
comprise an element in its own right, and may be a mechanical element, 
or it may comprise an SLM, or part of an SLM, controlled by the 
5 controller. There may be an additional SLM to perform the aperture size 
change. The aperture changer may have an aperture definer that has 
binary states (block/clear) or may have grey levels between block/clear . 

Post-detection processing by the image computer may improve the 
10 resolution of the apparatus. One region of the scene directed onto a 
detector element of the detector may not, after post-processing, 
correspond to one image pixel in the image produced. Image pixel 
averaging, weighting, or other post-image-capture processing may take 
place. 

15 

According to another aspect the invention comprises the use of a scanning 
device in an imaging system to scan parts of the scene over an 
image-capturing detector at different times so as to build up a pixel image 
of the scene. 

20 

The scanning is preferably used to control the scene pixel size that is 
scanned onto the detector. The scanning is preferably used to control the 
number of pixels produced in the image generated. 

25 Embodiments of the invention will now be described by way of example 
only, with reference to the accompanying drawings of which :- 



30 



Figure 1 schematically shows an optical assembly according to the 
present invention; 
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Figures 2 and 3 schematically shows other optical assemblies; 

Figure 4 shows a detail of the assemblies of Figures 1 to 3; 

5 Figure 5 shows schematically another optical assembly; 

Figure 6 illustrates schematically a principle of operation of some 
embodiments of the present invention; 

10 Figure 7 shows schematically a number of different patterns held in 

a computer database; 

Figure 8 shows schematically the aberration of an optical system 
and how the present invention can map the sensor plane of the 
15 optical assembly to the aberration; 

Figure 9 shows a detector imaging array; 

Figures 10a to 10 d show other detector arrays; 



20 



25 



Figure 11 shows schematically a scene being observed by an 
instrument according to the present invention and illustrates how 
the scene can be divided into pixels in the x-y plane, and indeed z 
direction, which are scanned over the instrument's detector array; 

Figures 12a to 12e show a linear pattern, a quadratic pattern, a 
cubic pattern, a binary combined linear and quadratic pattern, and a 
binary combined quadratic and cubic pattern; and 
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Figure 13 schematically shows the stepping of scan of scene 
regions over a fixed detector array. 



The reader is directed at this point to read our co-pending patent 
5 application PCT/GB98/02876. The disclosure and contents of 
PCT/GB98/02876 are hereby incorporated by reference into the disclosure 
of this patent application. Pending PCT/GB98/02876 will assist the 
reader in appreciating some terms used in the present application, and in 
appreciating how some features of some of the embodiments work. 

10 

Figure 1 shows an optical assembly 10 having: a detector or sensor 12, in 
this case an array 14 (linear in this example) of sensors 16 extending 
orthogonally to an optical axis 18 (the array 14 is best shown in 
Figure 4); a Spatial Light Modulator 20 (SLM); a focusing, 

15 light-gathering, lens 22; and a first imaged plane 24 and a second imaged 
plane 26 at a different distance along the optical axis 18 from the SLM 
20. In this example the sensors 16, SLM 20 and lenses 22 are all 
mounted in fixed relationship relative to each other, possibly on a 
framework (not shown). The lens 22 (or some other light-gatherer) may 

20 have substantially the same area as the SLM, but it may have a greater, 
possibly much greater, area. They may be one, two, or a greater number 
of lenses in the optical assembly. 

Figure 4 shows the linear array 14 in more detail and shows that each 
25 sensor 16 ideally has its own read out circuitry 28 (embodiments where 
this is not so are also envisaged, but it is preferred to have each sensor 
read out in parallel, possibly independently). In some embodiments the 
circuitry 28 also performs signal processing on the read out signals from 
the sensors 16. The sensors 16 can be read simultaneously in parallel. It 
30 will be noted that because there is a 1-D array 14, and not in 2-D array, 
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there is far more space for the electronics associated with the sensors. 
The electronics 28 and the sensors 16 may be provided on a common 
semiconductor chip (not shown) . 

The SLM in the embodiment of Figure 1 is a computer-controlled 
transmissive SLM capable of displaying computer-controlled patterns. 
The SLM 20 and the lens 22 comprise a programmable lens assembly, 
referenced, 30. There are many possible optical arrangements of lenses 
plus the SLM. 

Figure 5 illustrates the programmable lens assembly 30, a computer or 
microprocessor 32 controlling the SLM 20, and sensor 12, this time 
represented as a camera 34 (but it could be the array 14) . The camera 34 
may for example be a CMOS camera, or a CCD camera, or a 
photographic film camera, or a camera with the read-out of Figure 4. 

The lens 22 and/or the sensor/camera 34 may also be controlled by the 
computer 32 (or they may not be) . In some embodiments the lens 22 may 
be omitted. There may in the lens assembly 30 only be a SLM as an 
optical component with significant focusing power. 

The lens 22 collects light from a scene and directs it (typically partially 
focuses it) onto the SLM 20. The SLM 20 has displayed on it a pattern 
36 generated by the computer 32. 

The pattern 36 is schematically illustrated in Figure 7. The computer 32 
has in its memory a library of possible combinations of linear diffraction 
grating 40 (a to c) and quadratic (or higher order) chirp grating 42 (a to 
c). There may be two elements to the combination or more than two. A 
particular combination, for example pair 40a and 42a, are selected by the 
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computer and displayed simultaneously on the SLM 20. The combined 
pattern may be thought of as a combined chirp. 

The quadratic chirp 42a acts as a focusing lens as light encounters it on 
5 the SLM and focuses light onto a focal or imaging plane, referenced 44, 
which contains the linear array 14 of detectors. The choice of chirp 42 
determines which plane in 3-D space, 24 or 26 (or other), is the plane that 
is imaged on to the imaging plane 44. 



10 The diffraction grating 40 part of the pattern 36 determines how off- 
optical axis 18 is the centre point of the imaged plane in 3-D space, and in 
what angular direction away from the optical axis it lies. For example, if 
the grating 40 has infinite spacing between its lines (i.e. no grating 40) 
the centre of the imaged plane/imaged scene will lie on the optical axis 

15 18. The closer the spacing between lines of the grating 40 the further 
away from the axis 18 lies the centre of the field of view projected onto 
the imaging plane 44 the sensor array 14. The direction in which the 
lines of the grating 40 extend, relative to the optical axis, controls the 
angular direction of displacement of the centre of the projected field of 

20 view/displacement of the part of the scene that is focused onto the 
detector. 

Figure 12 shows a number of patterns. When a combined pattern is 
formed it is believed necessary to combine the linear (or near linear) and 
25 chirp (or near chirp or higher order) patterns as analogues to form an 
analogue combined chirp and then binarise it (if a binarised combined 
chirp is to be provided at all). Binarising the linear pattern and chirp and 
then combining the binarised patterns does not work well. Similar 
comments apply to higher levels of quantisation. 



30 




WO 00/1 781 0 PCT/GB99/03000 

13 

For example, Figure 6 shows a linear array 14 of sensors 16 extending 
vertically in the page, and the optical axis 18. It also shows a line 46 of 
centres 48 of fields of view displaced at different angles (for example al 
and cc2) from the optical axis. The line 46 is orthogonal (or otherwise 

5 transverse) to the optical axis 18, and to the line of sensors 16, By 
altering the linear grating component of the combined chirp displayed on 
the SLM 20 it is possible to scan the centre of field of view projected onto 
the line of sensors 16 along the line 46 (or through different angles al, 
a2 f etc.). For each angle a (or centre of field of view 48) the sensors 16 

10 detect a vertical "slice" of the scene image in the imaged plane. As the 
angle a is changed and sensors 16 capture vertical "slices" from different 
transverse (in this case orthogonal) regions of the image in the imaged 
plane. Thus the schematic arrangement shown in Figure 6 captures seven 
vertical slices of the imaged plane in the field of view, at different angles 

15 across the field of view. 

It is possible to use a 1-D array of sensors to build up a 2-D picture of a 
scene by scanning the part of the scene that falls upon the 1-D array of 
sensors across the sensors in a direction transverse (e.g. orthogonal) to 
20 the sensors. It is also possible to use a single detector/sensor, or to use a 
2-D array of detectors. 

It will be appreciated that changing the quadratic chirp element of the 
combined chirp changes the plane in the scene that is focused to the 
25 imaging plane of the optical assembly. By successive imaging with 
different chirps 42 it is possible to build up a 3-D picture of the scene. 
This can be done with a 1-D array of sensors, for example similar to that 
shown in Figure 5, or using a 2-D array of sensors, for example a CMOS 
or CCD camera, or a single detector. 



30 
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It will also be appreciated that if no off -axis "steering" of the region of 
3-D space in the scene to be focused onto the imaging plane is required no 
linear grating may be used on the SLM (or as part of the combined chirp) . 

5 If no change of imaged plane in the scene being imaged is required there 
may be no quadratic chirp, or the quadratic chirp may not change. 



It will also be appreciated that the plane in 3-D space of the scene that is 
brought into focus on the imaging plane of the optical assembly does not 

10 have to be a flat planar plane. It can be a surface, which can be curved or 
contoured. An appropriate combined chirp/pattern displayed on the SLM 
can bring practically any surface in the scene to be focused on the 
imaging plane in the optical assembly. It may do this by building up a 
complex surface by imaging scene pixels sequentially in time and 

15 changing the distance/orientation of the imaged plane between scene 
pixels. Using an SLM to steer and focus a beam of light, and having the 
SLM computer controlled and able to respond/steer very fast in real time, 
allows the SLM to act as a rapidly controllable, and very flexible, optical 
device. 

20 

Figure 3 illustrates the above by altering the combined chirp on the SLM 
to project onto the linear array 14 different "slices'* of an inclined plane 
50 (inclined to the plane normal to the optical axis), the slices that are in 
the imaged plane in 3-D space being at different depths/distances from the 
25 array 14, the detector array detects sequentially in time "slices of the 
scene" over the inclined plane. For example one slice 52 at a first 
distance (controlled by the chirp 42) is followed by another slice 54 at a 
different scene imaged plane (using a different chirp 42) . 
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Although the imaging plane in the optical assembly is envisaged primarily 
as being a flat plane, it too might be non-flat, and might be curved. 

The combined chirp displayed on the SLM is programmably controlled by 
5 the computer and different slices of an imaged plane can be sampled by 
the 1-D array at different times to build up a picture of the surface chosen 
to be the imaged surface. The slices sampled sequentially in time do not 
have to be adjacent in 3D space, but may typically be so. By controlling 
the spacing between the lines of the displayed diffraction grating element 
10 40, and the orientation of the lines on the SLM, the computer can control 
how off-axis is the region of the scene that is focused to the imaging 
detector 14. 

It will also be appreciated that the 1-D array of sensors could comprise a 
15 single sensor (i.e. a 1 element array). The desired part of the surface to 
be imaged would then be stepped across the sensor in two transverse 
directions by the SLM (probably two orthogonal directions) . 

Figure 2 illustrates a different optical arrangement where there is a 
20 lens 56,58 before and after the SLM 20. 

In Figure 4, the fact that the individual detector pixels/sensor elements 16 
are each separately addressed by read-out circuitry makes it possible to 
read out all of the sensor elements in parallel. This speeds up read out. 
25 Furthermore, it is possible to read out some only (and not all) of the 
sensor elements 16. This may facilitate rapid scanning of images and/or 
produce a fast imaging system. The control computer can determine 
which sensor elements are read, and when, depending upon the 
requirements of the user of the optical system. The control computer may 
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be programmable by a user, or a user may be able to select between a 
plurality of predetermined pre-existing programmes. 

The arrangements of Figures 4 and 6 enable a 1-D array of sensors (or a 
> single sensor) or a 2-D simple array of sensors to be used. This can be 
desirable in certain applications, especially where fast read out is 
important. Having a simple array is advantageous because simple arrays 
allow substantially all detectors to be read out in parallel. 



10 Figures 10a to lOd show examples of "simple" 2-D detector arrays. The 
detector elements are referenced 100 and read out/possibly some initial 
processing or amplification circuitry is referenced as 102 (shown only in 
Figure 10a). Simple arrays are capable of having substantially all of the 
detector elements 100 read out in parallel. Complex arrays, with detector 

15 elements surrounded by many other detector elements have difficulty 
getting individual read out of "buried" detector elements in central 
regions of the 2-D arrays. Some simple arrays have all, or nearly all, of 
their detector elements at the periphery of the array (this means that the 
electronics can be beyond the periphery in the same plane/intersecting the 

20 plane of the detector elements). It may be possible to have a limited 
number of detector elements read out sequentially and still get fast overall 
performance. For example, if the read out were pairs of detector 
elements, so there were only two to be read serially (but this would be 
slower than true parallel read out of all detector elements). It may be 

25 possible to have just one or two detector elements within an outer 
peripheral line of detector elements and still have room for circuitry for 
parallel read out. 

Figure 9 shows a 2-D imaging detector array 90 having separate 
30 lines 92,94,96,98 of detector elements 100 forming a grid. Each line is 
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read out separately, and in this embodiment alternate lines read out in the 
opposite direction (this allows the read-out electronics to have more 
space) . 

5 Although in Figure 7 the memory with a plurality of linear and chirp 
combinations is presented as having stored pairs of linear and chirp 
functions (and it may indeed have this), it is also conceivable that the 
memory may have a library of linear gratings, a library of chirps, and that 
the computer may select from each group to make a combined chirp. The 

10 pattern may be combined prior to display or actually only upon display. 

The use of a linear component in the combined chirp (to orientate the 
direction of view of the assembly off-axis) may not be necessary if the 
system has a 2-D detector (but it might still be used). 

15 

With reference to Figures 9 A to 9C of PCT/GB 98/02876, the concept of 
moving light sources relative to a detector array in order to scan an image 
over the array applies to imaging a scene by realising that each "pixel" or 
small region of a scene can be seen as a light source, and focusing a 
20 sequence of chosen light sources/scene regions onto the detector array 
(using the SLM) uses the same scanning concept. By controlling the 
pattern on the SLM it is possible effectively to leave turned "on" a region 
of the scene (in focus on the detector) whilst turning "off" other light 
sources/regions of the scene. 

25 

Figure 8 illustrates a possible application of the invention. Many optical 
systems have optical aberration, typically due to the combination of the 
aberration of a number of different optical components (for example in 
Figure 1, the lens 22 and the SLM 20 may have an associated aberration). 
30 The overall aberration of a system means that different regions of a scene 
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plane are not focused properly on an imaging plane. Plane 80 of Figure 8 
represents the imaging plane of a camera, and surface 82 represents the 
surface to which a flat plane in a scene is focused. It is possible to apply 
a combined chirp to the SLM to compensate for the aberration of the rest 

5 of the system. Line 84 represents how a combined chirp applied to the 
SLM 20 effectively modifies the imaging detector plane of the system (or 
looked at another way, how it modifies the plane in the scene that is 
focused onto the detector plane). Thus, once the aberration of a system is 
known it is possible to ameliorate, or substantially eliminate, the 

10 aberration using the combined chirp pattern. 

Alternatively, different combined chirp patterns can be used to 
compensate for different regions of the aberrated image. 

15 The principle of compensating for aberration using the SLM and combined 
chirp can be used to compensate for aberration in two dimensions. 

The invention has applications in many areas. A programmable lens is one 
application. Since an SLM can display thousands of patterns a second, 
20 possibly tens of thousands, or of the order of a hundred thousand, or 
more, it is possible to vary the programmable lens very fast (many 
thousands of times a second) . 

In one application, pattern recognition, there is a requirement for fast 2-D 
25 sensors capable of thousands of frames/sec (possibly ten thousand 
frames/sec or more). There is also a drive in the art of pattern 
recognition towards increasing the number of pixels needed in the 2-D 
array. The present invention allows the number of pixels forming the 
image to be increased or decreased by using appropriate combined 
30 patterns on the SLM. Each imaged frame of the scene needs to be 
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processed (e.g. digitally processed) serially. There are cameras which 
store data this fast, or faster, but which are processed off-line. In our 
earlier-filed patent application PCT/GB98/02876 (and incorporated herein 
by reference) is a technique which effectively scans a pattern across a 1-D 

5 sensor array by employing a 1-D array of light sources (e.g. VCSELs). 
This is effectively a series of point sources. Each point source is at 
different angles relative to the optical axis. Hence the 1-D sensor array 
(which is oriented perpendicular to the light source/VCSEL array) 
perceives the pattern displayed on the SLM to move across it if the light 

10 sources/ VCSELs are switched on one after the other. The number of light 
sources determines have many linear slices of a 2-D pattern are detected 
by the sensor. 

If a linear diffraction grating is displayed on the SLM (can be phase or 
15 amplitude) this causes a plane wave light beam to be deflected. The 
similarity with the light source/VCSEL array discussed above is that an 
image can be considered as a 2-D array of point sources. By changing the 
diffraction grating displayed on the SLM the scene can be scanned across 
a sensor array in the x-y plane. If a quadratic diffraction grating is used 
20 instead of or in addition to the linear grating on the SLM then a 3-D 
scanning can be achieved. Combining a programmable chirp with a 
sensor array enables 3-D imaging to be achieved. As shown schematically 
in Figure 3 it is possible to image any x-y-z plane or indeed any curved 
surface by suitably choosing the appropriate chirp combinations. 
25 Post-processing can reconstruct a 3-D scene. 

The chirp can be used to scan the image of a scene across a detector array 
(the detector array may be, for example, a 1-D array or a single element 
detector) in any combination of x-y motion. 



30 
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Some SLMs are wavelength sensitive. It may be desirable to illuminate 
the scene with a single wavelength light (e.g. laser) and/or filter the light 
incident on the SLM to make it substantially monochromatic. 

5 It may be desirable to use filters of different colours (e.g. red, blue, 
green) and build up a colour image. Some SLMs, for example those based 
on technologies such as micro-machined silicon, could be programmed to 
function with different wavelengths. This may give hyperspectral or 
colour capacity. 

10 

The invention is applicable in principle to all e.m. wavelengths, not just 
truly optical wavelengths. The term "optical" should be interpreted to 
cover e.m. radiation generally. It may even be possible to perform the 
invention with waves that are not e.m. waves (e.g. ultrasound or acoustic, 
15 or compressive waves) . Again the invention should be interpreted broadly 
in this regard. 

There may be an illumination source for the scene, or for the SLM (or 
both), or there may not be. 

20 

Currently 1-D CCD sensors are commercially available with 
200MHz pixel read out rate (Dalsa). 100MHz 2-D sensors are available 
and presumably 200MHz soon. However, they are inflexible because all 
pixels must be read out each frame. The fast read out rates are possible 

25 by designing multiple output taps; these split the device into parallel read 
out regions each with a plurality of sensor pixels. Each tap could be 
designed to be controlled independently but there is a limit to how may 
taps can be used: there is not enough space physically for the read-out 
circuitry. Research is studying flipchip bonding for full parallel read out - 

30 but this will be expensive and consume a lot of electrical power. A 1-D 
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array (or simple array), as now proposed, with full parallel read out is 
much easier to design and in combination with the combined chirp allows 
the possibility of full control of localised read out of an image. It is not 
necessary to have to read out all of the resolvable pixels of an image. 

5 

The spatial light modulator (SLM) may comprise a high speed light 
modulating array such as the Fast Bit Plane Spatial Light Modulator 
(FBPSLM) described in our earlier publication [see references 7 and 8 of 
PCT/GB98/02876L It may comprise an array of a ferro-electric liquid 
10 crystal material which may be provided on a substrate. 

The SLM may comprise an array of pixels or elements which can be 
switched between at least a first state in which light passes through the 
element whilst being modulated in a first way, and a second state in which 

15 light passing through the element is modulated in a second, different way. 
In each case, the light may be either retarded or amplitude modulated, or 
both. Preferably, each element comprises a liquid crystal pixel. The 
SLM may be either transmissive or reflective in operation. There may be 
substantially a 180° phase difference between light that has interacted 

20 with a pixel in the first state compared with light that interacts with a 
pixel in the second state. 

The SLM may be a transmission device, such as a liquid crystal, or a 
reflective device, such as a micromachined mechanical device (e.g. 
25 electronically-controlled movable members which reflect light). For 
some reflective devices the light does not "pass through" it (but for others 
it does - e.g. LC plus mirror), and perhaps a more general term would be 
that the light interacts in a plurality of ways with the device depending 
upon the condition of regions of the device. 

30 



WO 00/17810 



PCT/GB99/03000 



22 

In a refinement, the lens may be integral with the SLM itself. 

As discussed in PCT/GB98/02876, the present invention can be used in 
pattern recognition, with a programmable chirp/SLM, possibly capable of 
5 changing its chirp/combined chirp many, many, times a second. 

Another advantage which has been demonstrated is that the application of 
a chirp signal allows slightly non-planar SLMs to be used while still 
producing a usable optical output (for example a correlation pattern or 
10 other use for the programmable SLM). Such non-planar SLMs can arise 
through imperfections in the manufacturing process, and are much cheaper 
than optically flat SLMs, since the latter have lower yield. 

The chirp/combined chirp compensates for aberrations, as discussed 
15 earlier, which allows the use of SLMs that are less than optically flat, in a 
variety of applications. Indeed, a further way of looking at one aspect of 
the invention is as a way of using less perfect SLMs than has hitherto 
being possible, by compensating for optical imperfections by applying a 
pattern to the SLM. 

20 

Experiment has shown that for pattern recognition the chirp combination 
should, ideally, be added before the pattern is binarised and can be added 
to both patterns or to only one of the patterns. It is probably more 
convenient to pre-calculate the pattern and add it to the reference pattern. 

25 It is therefore possible to compose a set of patterns with different chirps 
so that the chirp can be chosen randomly from a list in real-time or 
sequentially to produce a scanning focus in the z-direction. Combination 
of a linear and quadratic (or higher order) pattern allows the focus to be 
varied in three dimensions in real-time. For example, the current design 

30 of the FBPSLM allows the chirp pattern to be changed approximately ten 
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thousand times per second. Applications could include the memory access 
of optical discs and holographic memory without the requirement for 
mechanically moving parts. 

5 In some applications a variable chirp may be required, for example, 
time/frequency analysis in Wigner Transform or Ambiguity function, 
where an unknown chirp may be present in the input signal. The purpose 
of applying additional chirps is to find the one which negates the unknown 
chirp in order to retrieve a desired signal. 

10 

The chirp could also be used by an SLM with more than two modulation 
levels (i.e. not binary). This would have the advantage that multiple 
modulation levels produce only one correlation peak (in pattern 
recognition) and the optical throughput is therefore more efficient. 
15 Although the ambiguity of sought-object location is removed by having 
only one correlation peak there is still a problem caused by the presence 
of a DC peak. 

It should also be noted that the chirp has a similar mathematical 
20 description to a lens and it has been shown experimentally that it is not 
necessary to use a lens in conjunction with the chirp. This simplifies the 
optical system design. 

One area where time/frequency analysis using an optical assembly having 
25 a programmable chirp-driven SLM might be used is if an electromagnetic 
signal encoding data (or not) were emitted from a moving platform it 
would be chirped (quadratic function) if the platform were 
accelerating/decelerating. By applying a corrective chirp in return to a 
"correct" signal, it is possible to clean up the signal, and (or instead) to 
30 determine the acceleration/deceleration of the platform by a knowledge of 
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which corrective chirp successfully compensated (the library of corrective 
chirps would have an associated acceleration with each chirp). 
Alternatively, the de-chirping chirp could be calculated by a computer 
upon analysis of a received chirped signal. A signal may be deliberately 
5 chirped for transmission and de-chirped at the receiving end. 

Although a "pixel" is referred to, and although the SLM is primarily 
intended to have pixels (discrete controllable areas provided in an array), 
it is also intended that "pixel" be interpreted broadly enough to cover 
10 non-pixeliated devices (not truly pixellated), such as optically addressed 
SLMs incorporating a photoconductor or other photosensor. 

In many applications the optical system will be an imaging system, but 
perhaps in not all. 

15 

Although "the display of the SLM" is referred to it will be appreciated 
that this term also covers the light-modifying properties of SLMs which 
have an operative surface which has regions capable of introducing 
different phase or amplitude changes on incident e.m. radiation, such as 
20 movable mirror or movable piston-type reflective SLMs, as well as 
transmissive SLMs. 

There are times when the demands of technology change and there is an 
increasing demand for greater resolution in electronic imaging devices. 
25 This is traditionally addressed by providing more and more pixels in the 
detector array. Seemingly, however big the detector array, and whatever 
its resolution, a better one is always wanted within a few years. The finite 
number of detector elements in the detector array limits image resolution. 
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The present invention also has application in ameliorating this problem. 
Because the computer controller effectively pixellates the scene being 
observed and scans it over a fixed array of detectors (or even a single 
detector), it is the computer which determines (in part) resolution, since it 
5 determines the number of image pixels created by controlling the x-y 
scan. 

Figure 1 1 illustrates a scene being imaged by a camera in accordance with 
the present invention. Scene "pixels" 110, 112, 114, 116 are regions in 
10 3-D space which are directed (almost always focused) onto the detector 
array /detector of the camera by the SLM. Changing the resolution of the 
scene pixels is effected by a change of commands from the computer to 
the SLM (and so better resolution can be achieved without changing the 
detector array) . 

15 

Figure 13 shows a detector 12 having a small number of detector elements 
16 and shows schematically areas 130 where light from computer- selected 
regions of 3-D space in the scene is directed/imaged. The computer/SLM 
scans the scene regions over the detector elements 16 in the direction of 
20 arrow 132 and in the transverse direction of arrow 134. As many image 
pixels are captures as are required. 

Using the SLM to scan volumes of the 3-D scene onto the detector array 
(or single detector) allows the control of the number of pixels in the 

25 image picture to be computer-controlled, rather than being controlled by 
the hardware. The computer can control the SLM (or other 
scanner/focuser) to display a pattern to create a wider field of view for 
the image created. The computer can alternatively use patterns displayed 
on the SLM to achieve a greater resolution in the image produced by 

30 keeping its physical size/field of view the same but using an increase in 
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the number of image pixels created by scanning the image over the 
detector to increase the resolution of the image. The computer could, of 
course, achieve both. 

5 One reason why an optical system might be required with a variable 
resolution and/or variable field of view is if its numerical aperture was to 
be varied. It may be desirable to vary the aperture size of the system to 
change its depth of focus/depth of field (it may be desired to concentrate 
the imaging on things that are at about a specified distance from the 
10 optical apparatus). 

Changing the aperture size changes the depth of focus. Reducing the 
aperture size increases the depth of field - reduces the resolution in the 
z direction that is required. Reducing the aperture size reduces the field 
15 of view required, and so fewer pixels are needed to form an image of any 
given resolution. If fewer pixels are required, the image can be created 
faster. 

On the other hand, increasing the aperture size decreases the depth of 
20 field, and increases the field of view. More pixels in the image are 
required to image that field of view. In order to achieve an image in a 
predetermined time, the resolution may need to be reduced (or the larger 
number of scans of the scene required will add to the time taken to form 
the image) . 

25 

The aperture, and aperture control, may be provided as a component 
spaced away from the scanner/SLM (either before or after the scanner) , or 
it may be provided at the scanner/SLM. It may be provided at or near to 
the Fourier plane (e.g. in confocal microscopy an aperture control at the 
30 Fourier plane may be desirable). 
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It may be helpful to provide some definition of some of the terms used:- 

" combined chirp" - this can be a combination of linear, quadratic, cubic, 
5 or higher order patterns, or a modified pattern which is substantially 
similar to such a combination; 

"optics" - the invention applies to any radiation wavelength for an 
electromagnetic radiation, and to compressive waves; 

10 

"imaging" - this can be to the image plane of an optical device, or to a 
Fourier transform plane, or to a plane which is neither; 

"focusing" - a plane where the detectors are placed and receive radiation; 

15 

"colour" - not just optical (red, green, blue) but can be multiple 
wavelengths; 

"simple array" - an arrangement of detectors which allows parallel read 
20 out by electronics - for example one where all or substantially all 
detectors are at the peripheral edge of the array. 



